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ABSTB&CT 

Although teacher>developed materials are usually 
created with objectives designed for a particular group of students 
at a particular point in tiae, they baj be valuable for use by other 
instructors, at other institutions, in other circumstances. Materials 
which are iaiediately transferable to other situations should be 
called "usable." Haterials which do not fit an of these criteria, 
but which are capable of adaptation to other circuistances should be 
called "aseful." A teacher*developed resource that is ready for 
convenient use is packaged in such a way as to specify 
student-centered objectives, student-benefit evaluation criteria, and 
student-paced resources. Haterial can be defined as "usable" or 
"useful" on the basis of teacher evaluation, computer evaluation, or 
a pre-test/post-test method. Once the quality of a resource is 
identified, it should be compared with other resources and rankings 
should be wade. (Author/DC) 
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i wrote it, 
i*m a scholar, 
it's gotta be good 

In the sense of publishing a book, the typical college professor is 
not an author. 

In the sense of producing thousands of words that are reproduced and 
distributed to students, the vast majority of dollege professors are 
authors • 

What's the difference between a published author and a mimeographed 
author? 

I don't know, but I've got a few ideas. Most of these ideas 
can be summed up in the one word use-ability, comnonly spelled'-usability. " 

It is not un"«ual to find college pvofessors who write out every 
word they teach. The percentage is approxim^.cely 5% according to a recent 
sampling. This means that, if there are 20 professors on your campus, at 
least one of them has written out almost every word to be taught. 

A vast majority of professors have an outline of what is to be taught. 
Sometimes, the outline is in the form of content, and at other times it is 
in the form of course objectives. 

A recent sampling indicates that approximately 65% of college 
professors do this. This means that 13 professors out of 20 write what 
is to be taught although they do not write out every word. 

The other 30%, that is, the other 7 professors, are the type that 
extemporize. 
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If this professor is not very good, the students say that the professor 
simply doesn't prepare lessons* If the professor is f ".Intillating and able 
to carry on a talk show type of course, the students say, "The guy is 
fantastic::!" 

If you are looking for an approbation of either witlng everything out 
or of never writing anything out, don't read any farther. This report has 
an entirely different objective. 

In a wordy the idea behind this report Is usability. 

Now that we've said it for the second time, you can conclude that "usability*' 
is an Important idea. 

Usability refers to the ability of teacher-prepared materials to 
facilitate and Increase student achievement. 

Let's not get hung up on definitions. Let's go to a few examples. 

If a carefully penned lecture delivered by you never gets published 
but does result In student enthusiasm (affective gains), student applications 
(psychomotor gains), or* in Increased insight (cognitive gains), then your 
writing Is usable. 

In the same way, a carefully outlined lect ire that stresses either 
subject matter or objectives is deemed usable If students acquire an 
Increase In DATA POWER (knowledge objectives), PEOPLE POWER (attitude 
objectives), or THING POWER (performance or skill objectives). 

Similarly, if an extemporized class, devoid of any written preparation. 
Is able to ignite learner curiosity (conceptualizations, generalizations, 
and information), learner Involvement (study habits, on the job applications, 
and appropriate behavior) or learner valuables (attitudes, emotions, and 
commitment), then this material Is usable. 
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The question naturally occurs, "What do you call material that answers 
the above questions negatively?" 

The polite answer is "Useful." 

In other words, usable teacher-prepared materials are ready for 
immediate, convenient, and feasible use today, by many teachers, in many 
schools, with many students, and for objectives relevant to many students 
and teachers even when these objectives are slightly different from the 
objectives of the original writer. 

Materials that don't fit all. the criteria of usable are called 
useful because most of these materials are capable of being put to use 
someday, by someone, somewhere, with some students, and for some objective 
that are almost' identical with those of the author. 

The individual reader may not be as charitable in assigning the word 
useful as indicated above. However, as this author has said in the title, 
"A scholar wrote it, it's gotta be good." As far as good in concerned, 
this is d<^fined as being at least minimally useful. 

Useful is the low end of the scale on which usable is at least half 
way to "publishable" in a variety of media. 
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EVALUATION AS KEEPING SCORE 
WITH A MAXI^aJM OF PRODUCTS 
AND 

A MINIiaJM OF PAPERWORK 



I've been using objectives all my life, BUT I 
never have written them out and I won't start now. 

My job is teaching. I don't want to waste 
time doing a lot of unnecessary paperv7ork. 

I've gone to workshops or ^dependent study 
and individualized self-instructional packages. 
There must be an easier way to do this. After 
all, I'm a teacher, not an author. 

If I kept track of everything that students 
do right and do wrong, I wouldn't have any time 
left to teach, to show them what to do, and to 
encourage them. 

/ 

Do the above comments sound familir^r? 

Hiey should. After all, these were a few of the reactions made by 
full time teachers after looking at the January 1975 issue of INDUSTRIAL 
EDUCATION. 

Most of the comments were caused by rapidly glancing at two articles. 
The first one was by Dean Teal and entitled "Individualized Instruction 
Packages Made Easy," and subtitled "How to Make Up Self-Instructional 
Materials for Cooperative Education Students." 

The second article was by Ray D. Ryan and Wayne Berry and entitled, 
"Motivating Your Students With Independent Study." 

Nobody agrees with everything another person has to say. After all, 
that's the dignity of human opinion. 



On the other hand. It became obvious that the preceding comments 
were due to a hasty reading more than to a disagreement. 

If yoM<ion*t recall the article, it might be enough to remind you 
that Teal's article ga /e forms and examples of how to put together a 
self-instructiondl package. This self-instructional package is structured 
by the teacher and consists basically of objectives, pretesting, learning 
activities, and posttesting. Objectives pointed out what the learner was 
expected to do. Pretesting helped the learner preassess previous related 
accomplishments and experiences. The learning activities provided a 
variety of things to do in order to learn the objectives. The posttesting 
consisted of a number of criteria that could be used by both teacher and 
student to evaluate success. 

Teal's package is described as being structured because it was 
designed by the teacher and contained four above components of a module. 

On the other hand, the package developed by Ryan and Berry can be 
described as being unstructured. In this package, the student lists a 
certain number of independent study objectives. Alongside the objectives, 
the student lists a description of each learning activity in five or six 
words. Alongside the learning activity is a check date. Alongside the 
check date is space for the teacher to decide whether or not the activity 

has been satisfactorily or unsatisfactorily. The paperwork is kept to 
a minimum by equatii^g OK with satisfactory and X with unsatisfactory. If 
a job is done unsatisfactory, the student uoesn't go any farther until 
the X is replaced with an OK. 



10 



8 



ERIC 



The format of Ryan and Berry is called unstructured because the 
student and not the teacher decides the details of what is to be done within 
the framework ox the teacher's generalized guidance. Similarly, the 
student has k share in setting up check dates. The teacher's evaluation 
takes on the role of an impartial umpire. In addition, there is no 
complicated mathematical counting to decide how* well the product is done. 
The student keeps on tiying until the job is done well, no matter how 
much time ic takes. 

Thus, on pages 26 to 30 of the January issue of INDUSTRIAL EDUCATION 
the teacher is exposed to at least two different formats of a student-paced 
learning module- ^ 

Fortunately for the teacher, both formats of modularized or independent 
study are easy to imitate. After all, the authors were good teachers and 
gave plenty of examples. 

The question arises, "How usable is this material?" 

Any educator worth his salt is familiar with the situation wherein 
material designed by one excellent teacher is found completely unsuitable 
for use by another equally excellent teacher. 

Self-instructional materials that work with one student, in one 
school, with one teacher, and on one grade level don't always work when 
any one of the preceding elements is even slightly different. 

If the above commonplaces are true, then it seems that each teacher 
must develop self-instructional materials all by himself. It might even 
mean that each student must have a specially demised piece of learner-paced 
material. 
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Stop right there. 

If that much individualization is to prevail, the cost become 
prohibited in terms of teacher time, money, effort, inti^yest, and good 
sense. 

Something is wrong when a teacher is told that everything to be 
taught must be written out in every detail before it can be taught. 

Something is wrong when a teacher concludes that something developed 
elsewhere for a slightly different objective, for a slightly different 
type of student, and in a slightly different atmosphere is absolutely 
unacceptable locally. 

There must be a simple way to determine usability. 

Usability means that a teacher can borrow other materials from 
colleagues without having to worry about whether or not this material will 
work when given to a student ready to learn on his own. 

In the case of the structured module, there is a simple way to do 

this. 

Give the student some kind of an evaluation BEFORE placing the student 
in contact with the individualized self-instructional package. 

Give the student a test AFTER contact with the same material. 

If the test given before hand is too high, either the test is too 
easy or the material is too easy. 

If the test given before hand is low and the test given afterward 
l8 high, the teacher can make a prudent judgment that this material is 
USABLE. 
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When this happens, it's like getting bingo! 
Both the teacher and the learner win. 

In the case of the unstructured material, this pretesting and 
posttesting pattern simply doesn't work. 

There is a much simplier way to keep score here. 

Look at the product. When the product gets to the final acceptance 
sta^e, note the date of final acceptance. 

Thas, if the product was started on January 31st and finished on 
February 25th, the teacher must decide whether or not this was a reasonable 
length of time considering the worth of the finished product. 

After a while, a teacher will be able to estimate how long it takes 
for a student to make a table, a lamp stand, design. a bathroom or 
execute some equally worthwhile products. 

CONCLUSIONS 

Anybody who rereads this article will find that there are no forms 
to fill in. 

The paperwork has been kept to such a minimum that most teachers can 
do it in their head. 

Whether it's done on paper or in the head of a teacher, these simple 
measures of usability give a teacher a track record against which to judge 
future projects given to learners in independent study. 

If the usability of a product is low, this means the teacher must 
intervene and teach. 
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If the usability of a product is high, this means the teacher can 
give it to the student and allow the learner to proceed on his own steam. 

During this time of independent study, the teacher avoids merely 
sitting back. The teacher is acting as a human being who gets to know 
students and individualized requirements. 

This kind of humanistic activity in a school where people are 
Important is much better than unnecessary paperwork. 
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INTRODUCTION 



Computers are now being used among other things as: 

A) Typewriters 

B) Printing Presses 

C) Test Scorers 

D) Report Cards 

E) Envelope Addressers 

USE^ability suggests that, at the some budgeted cost PLUS a few hours 
of local planning and a few minutes of pi-ogramming time, computers can be 
used to: 

A - Identify usable teacher-developed materials 
B - Compare psychomotor and affective measures 

on a Likert scale 
C - Separate hi-gain independent study materials 

from low-gain materials by teacher-prepared 

pretests and posttests 
D - Subdivide hi-gain independent study materials 

into various learning styles based upon 

learner types 

The computer programming is left to each center. The "suggestion" to 
think it over, weigh the pro's and con's, and DECIDE is the main point 
behind USE-ability. 

The value behind USE-ability is the fact that it's countable and 
computerizable- for knowledge, performarce, and attitude gains. 

If you liko the idea, you don't even need a computer. All you need 
is a pile of 3 x 5 cards and enough organization to do things systematically 
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This short article on usability answers the question, "Can the materials 
prepared by an individual teacher be used by other teachers, with a wide 
range of students, on objectives slightly different from those enunciated 
by the original teacher?" 

If the answer is yes, this teacher has usable materials. 

If the answer is no, this article tells v;hat the teacher can do about 

it. 

The solutions proposed in this article are low cost. 
This means that one principle is utilized to distinguish between two 
technological solutions that are equally effective. 
Choose the least expensive alternative. 

Sometimes, when the cost is equal, this boils down to: CHOOSE THE 
SIMPLEST ALTERNATIVE. 

Again, all of this advice can be summarized in a short principle: 
AVOID COMPLICATED SOLUTIONS THAT CONFUSE TEACHERS AND STUDENTS ALIKE • 

The solutions herein proposed have been tested on the communi::y college 
level in courses of general education, liberal education, occupational 
education, vocational education, career education, humanities education, and 
prc-university studies. 
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SCALABLE DIMENSIONS OF USABILIlTf 
Scalable means capable of being scaled. 

To scale usability means to gradate, measure, estimate, pattern, 
make, or arrange in a sequential series. 

Sometimes the scale will go from high to low. At other times, the 
scale will go from low to high. 

Since usability is something that cannot be weighed on a scale, 
neither in pounds or ounces nor in kilograms or grams, it is necessary 
to think of scaling of usability a^ ranking. 

Ranking means to determine the relative position of the usability 
of one product, process, or activity in relation to others. 

When several products are ranked for usability, some will be found 
more usable than others. Products that are found to be almost unusable 
will be said to have low usability. 

Products that are usable under a limited variety of circumstances 
will be said to have moderate usability. 

Products that are found to be usable in a wide variety of circumstances 
will have high usability. 

With such printed materials as texts, modules to be read, books, 
periodicals, typed materials, and the printed text of cathode ray tube 
presentations, usability is equivalent to readability. 

Readability is concerned with data, knowledge, and the cognitive 
domain. 

For such things as projects, external activities, performances, 
procedures, hands-on activities, usability is equated with DQability. 
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DOability refers to skills, things, performances, and the psychomotor 
domain* 

For such things as role playing, modeling, simulation, value analysis, 
interactional analysis, professional standards, ethics, and attitudes are 
concerned, usability is equated with valuability. 

Valuability is concerned with people, attitudes, and the affective 
domain. 



Each of these three domains, cognitive, psychomotor, and affective 
can be further subdivided. 

The table on the following page entitled SCALABLE DIMENSIONS OF 
USABILITY, gives several of these subdimensions under the: 



Cognitive Domain (data) 
Psychomotor Domain (skills, things) 
Affective Domain (people) 



Each of these interrelated terms will be described. 
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SCALABLE DIMENSIONS OF USABILITY 



DATA 


SKILLS, THINGS 


PEOPLE 


READABLE 




DOABLE 




VALUABLE 




Viewable 
Gestaltable 


(Lo) 
(Hi) 


Demons Lrablc 
Repca table 


(Lo) 
(Hi) 


Imi table 
Modelable 


(Lo) 
(Hi) 


Hearable 
Lislcnablc 


(Lo) 
(Hi) 


Startable 
Imi table 


(Lo) . 
(Hi) 


Disil lusionable 
Creative 


(Lo) 
(Hi) 


Heir.or liable 
Unf or^»,ettablc 


(Lo) 
(Hi) 


Visible 
Observable 


(Lo) 
(Hi) 


Unfatiguable 
Innovative 


(Lo) 
(Hi) 


Visualizable 
Thcorizablc 


(Hi) 
(Lo) 


Performable 
Job-Able 


(Lo) 
(Hi) 


Witnessable 
Martyrable 


(Lo) 
(Hi) 


Thcorizable 
Visualizable 


(Hi) 
(Lo) 






Qamable 
Simulatable 


(Lo) 
(Hi) 


Explainable 
Showablc 


(Lo) 
(Hi) 










Shov;able 
Explainable 


(Lo) 
(Hi) 
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WORDS, WORDS, WORDS 
REPLACED BY 
SIGNS, SYmOLS, MEDIA 



It is undeniable that words have mattered to human beings for many 
centuries. After all, how else to explain the popularity of t^e printed 
page. 

For just as long, if not for longer, signs, symbols, and media has 
mattered just as much. 

If a researcher goes through notebooks, lists, collections, and 
diaries, a number of significant human artifacts will turn up. 

Words do pluy an important part in recorded human history. 

On the other hand, much can be learned from the following: 

Pictures of intangible ideas 

Photographs 

Collages 

Advertisements 

People 

Signs 

Symbols 

Media 

It is not unusual nowadays to hear people talk about giving COLLEGE 
CREDIT FOR A WELL HORN LIBRARY C.vRD. 

This me-^ns that a good reader has got the equivalent of many components 
of a college education. 

Now would be a good time to give college credit for STRAINED EYESIGHT 
AND SCRATCHING ONE'S HEAD trying to figure out what is meant by various 
human signs and symbols^ qH of which can be scaled. 
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Flowchart 



Stops 



1. Number each learning packet 
with a local code 



2. Number each test, parallel 
test, and alternate test 



LP - 06 - 04 - 


01 




E.g., Field = 


06 


= Technology 


Subfield = 


04 


= Data Processing 


Package = 


01 


= Learning Package 






Tool 



TLP 



01 
•H 

06 



<u to 

•H CO 

^ O 
CO 

CO (U 

04 - 01 



- A 



TL? - OC ' 04 - 01 - B 
TLP - 06 - 04 - 01 - o 
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3. Enter learner data by 

0 learner type; (to be 
determined locally) : 

and 

• learner score: (preferably 

a Likert scale): 

on both 

• pretest (B = Before): 

and 

• posttest (A = After): 



TLP - 06 - 04 - 01 - B - 04 



TLP - 06 - 04 - 01 - B - 04 - 15 



BTLP - 06 - 04 - 01 - B - 04 - 15 



ATLP - 06 - 04 - 01 - B - 04 - 85 



4. Program coir.putcr: 

Compute ''Gains Score = A-B" 

22 



ATLP - 06 - 04 - 01 - B - U4 - 85 
BTLP - 06 - 04 - 01 - B - 04 - 15 

GAIN SCORE = 70 
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5* Program computer: 

Tabulate "Frequency count of 
gain scores" 

by "TLP -NN-NN-NN-A- NN" (Student type) 

by "TLP - NN - NN - NN - A" (Learning package) 



6* Develop a ranked order of 
expectancy tables on a 
continuous basis 



Once basic scoring data is in, 
go on to include SCALABLE 
DIMENSIONS OF USABILITY to 
correlate Lenrning Packages 
with learning styles 
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FORGET ABOUT READABILTTY 
CONCEKTIUTE ON USABILITY 



It is sale to assume that most teachers don't do things that are 
useless. Thus, almost everything done or produced by a teacher is useful 
in the sense that it is capable of being put to use someday, by someone, 
somev;here, with soK'.e students, and for some objectives. 

No matter how useful this material might be, a difficulty emerges 
when another teacher tries to use it. This often leads to the difference 
between useful as defined above and usable. All material found useful 
by its author is not necessarily usable by soiiieone else. 

In order to he usable, material must be ready for inniediate, convenient, 
and feasible use today, by many teachers, in raany schools, with many students, 
and for objectives relevant to a range of students and teachers. 

In addition to tracing out some of the practical implications that 
arise once an educator , distinguishes betv;epn useful and usable materials, 
this article goes on to specify a few low cost ways to revitali/ie teacher 
developed materials. 
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FORGET ABOUT READABILITY 

The typical classroom teacher finds it easy to count sentence length. 
It*s so easy that it becomes boring. 

The typical classroom te.icher finds it tedious to measure v;ord 
difficulty. It's so tediors that the practice is often abandon. 

Since most readability formulas rely upon sentence length and word 
difficulty indices, these formulas are not going to be tried very much or 
very often. 

There seems to be a growing concensus both in the literature and in 
the classroom that readability formulas are for the birds with lots of extra 
time — and for the enpcrti>. 

The preceding sentence is meant in no way to malign the scholarly and 
scientific nature of readability formulas for certain specified purposes 
and for certain specified professional audiences. 

The comment was made in a flippart mariner to call attention to the 
fact that the typical classroom teacher wants something else. 

The classroom teacher wants to provide materials that relate 
to subject matter, correlate with necessary skills, and foster an enthusiasm 
for learning on the part of the student. 
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CONCENTiUTD ON USABILITY 

In practice, this means that the tei»cher must chose materials that are 
ncit^er too boring nor too challenging. Since it is difficult to find one 
book or one resource that is exactly right for the range of experience, 
skills, and interests f. nd in the typical classroom, most teachers provide 
a variety of materials. 

Certain materials, both commercial and teacher developed, are meant to 
be used on their ov;n. 

For example, a teacher gives a student a book, a learning package, a 
module, a self-instructional unit, or a learner-paced set of prograirmed 
instruction. The learner is expected to take the material and learn from 
it. 

The typical double check in this instance is to make sure that the 
readability level is appropriate to the student. This can involve? a lot 
of time with little payoff. If the readability level doesn't offer a 
challenge, the learner may simply lose interest not because of difficulty, 
but because of boredom. If the material is written in such a fashion that 
it is incomprehensible to the student, the learner will achieve nothing not 
because of lack of interest but because of unreadability . 

We have already mentioned that readability is difficult to measure. 
Now is the time to switch over to usability. 

This is no Lime for a scholarly dissertation. Here are a few simple 
ideas on how to establish usability. 

Read the material yourself. If it's no good, if it's dull, if. it*s 
too difficult, if it doesn't make sense, then throw it away. 
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If it laakes sense to you, try to come up with an objective instrument 
with which to measure success in students exposed to the material. 

Keep the examination short. As a rule of thumb, develop one objective 
question for each 5 minutes of typical student exposure. If the student 
is expected to spend an hour and a half with the package, then develop a 
15 to 20 question examination. 

After the examination is developed, give it to typical learners before 
giving them the material. 

Note the score of the students before being exposed to the material. 

Kote the score of the students after being exposed to the material. 

The difference between the before and after scores is an index of 
usability. 

You are the person who is going to establish the norms ot usability. 
Here are a few norns with which to begin: 

1. If most of the students answer more than 
half of the questions successfully before 
exposure to the material, your questions 

need revision. Make the questions more difficult. 

2. If most of the students answer less than 
one-fourth of the questions before 
exposure to tuo material and most of the 
students answer only half of the questions 
after exposure to the material, most likely 

the usability is low. Make the questions easier. 

3. If the typical before teist is low and the 
typical after test is hipji, you can be fairly 
certain you have uj;able material. 

4. Be selective in developing your usability 
formulii. Perhaps, you will find out that 
certain materials are more usable with 
male students th;'n with female students. 
On the other hnnd , you may loarn that 
other measures such as attendance, grades, 
standardizrd exnns, class conduct, and 

Q concentration power are related to usability. 
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Don't try to be a scientific researcher instead oa" a teacher. 

After all, usability is for you to use, not to theorize about. 

How are you going to use the usability index? 
* 

The answer is up to you. If you can find material that is considered 
high in usability, you are able to take this material and give it to a 
learner who will then proceed to become an aggressive learner able to 
achieve success indepenoently . 

Wouldn't you like to be able to tell which of the materials you have 
bought, developed, stolen, borrowed, or discovered are usable. 

The usability index is one way to answer this question. 

CONCLUSION 

Readers of thci above article tend to equate usability with 
readability. Thii; is correct for printed materials such as texts, 
modules to be road, and the printed text of cathode ray tube presentations. 
When tape recorJings or audio ca:-settes are used, usabilit> can be equated 
with listenabili Ly. When video tape is used, usability can be equated with 
vicwability. When projects are used, usability can be equated \;ith doability. 
When role playing and modcfling are used, usability can be equated with 
Imitability, 

In each of Lliest* variations, the sairc procedures to measure the 
difference between the before' test (pretest) and the after (posttest) are 
to be employed. 
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INTRODUCTION 



It is difficult enough to establish educational policy when the 
individuals concerned disagree on the basic facts. But, it is sometimes 
even more difficult to establish policy priorities when the individuals 
agrcc on the factsunder study but disagree on how to interpret these facts. 

Here are 3 facts upon vhich most educators agree: 

FACT ONE: 

The preparation of tegcher-developed niaterials consumes 
a large amount of time, personnel, budget, resources, 
and space. 

FACT WO: 

The author or authors of teacher-developed materials 
usually find these homemade remedies to be exactly 
what is required for a local situation. 

FACT TllR£E: 

Educators, other than the .lUthors, often reacc to 
the very same teacher-prepared materials by exclaiming, 
••What a waste of timel These materials won't v;ork 
in our school I" 



Too much stress on fact one leads to the conclusion, "It's cheaper 
to buy conmiercially prepared materials." 

Too much stress on fact tv;o leads to the conclusion, "Textbooks and 
commercially prepared materials are both inappropriate and too expensive." 

Too much stress on fact three leads to the conclusion, "If the 
teachov wants to get the job done right, the teacher must do everything 
personally and forget about expecting any help from others." 
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The author of this article accepts the above three facts, but rejects 
the above three interpretations. 

This article is neither a rejection nor a condemnation. In a 
positive attitude, the author distinguishes 

between useful and usable teacher-prepared 
materials, 

between diagnostic pretesting and mastery 
posttesting) 

betx.'eeii achievement and aptitude, . 
betwe'^n inforiration gained and previous 

Information, and 
between readability and unusability. 

Each of the above distinctions is followed up with practical examples 
in terms of things teachers can do to turn usefui. but impractical teacher- 
prepared materials into usable and convenient teacher-prepared materials. 

After demonstrating that the typical teacher can make teacher-prepared 
materials more usable by making them more readable, the author shows a 
very simple procedure that any teacher who has ever corrected a multiple 
choice test-can use to, improve the readability of personally developed 
learning materials. . 

The author feels that any teacher who has put in four or five hours 
on a weekend preparing teacher-prepared materials is ready and v/illing to 
spend an extra half an hour to make these self -same materials more 
beneficial to loarnors. This article shows how to make the extra follow 
through necessary to improve documented learner benefits* 
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A mi LttJ COST WAYS 
TO REVITALIZE 
TE/iClIER DEVELOPED M/\TERIALS 

It is disappointing to walk into a school and to discover large 
amounts of teacher-developed materials lying around vTithout being used. 
Somehow or other, these useful materials developed widi many hours of 
teacher effort and enthusiasm are found to be unusable. 

Whenever a teacher developed resource is left on a library shelf, in 
a dust covered file cabinet, under a pile of papers on a teacher's desk, 
or in a bulging envelope, effort has been wasted. The obvious solution 
would be to co;nc up with iomc inexpensive technique to make these material? 
more usable. 

The dictionary tells us that the term USEFUL means capable of being 
put to. use. The term USABLE means convenient and practical for use. 

Saying that a teacher developed resource is practical is the same thing 
as saying that this teacher resource is feasible. Going into the word 
feasible implies that the teacher using a usable teacher resource can 
reasonably expect success. 

Obviously, the vast majority of teacher developed resource?; are useful 
in the sense that someone, somehow, someday will find a particular resource 
to be exactly what is needed for a highly specific problem. 

On the other hand, most useful teacher developed resources dor/t 
receive much usage because these resources are not usable. 
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A usable resource is both CONVEMIENT and FEASIBLE. A convenient 
teacher developed resource is something that can be used immcuiately, 
with minimum modification, and with a wide variety of learners. A 
feasible resource is one that offers a great Hkelihood of success to 
both teacher and learner. 

After this brief introduction, it might be good to pause and look 
at the following page entitlod VOCABUURY REVIEW. Each of the terms 
discussed above is presented with a summary definition. It is hoped 
that this sumT.ary definition clarifies the distinction between USEFUL and 
USAliLE. 

There is a lot to be said for this distinction between useful and 
usable. This distinction has been able to help increase the efficiency 
of teacher-dcvclopcd materials. 

This increase in efficiency has been done by stressing imm?.di.ate 
use, convenient use, and feasible use. 

A teacher developed resource that is ready for immediate use is 
ready to go upon arrival. There is little need for elaborate set-up time. 
A busy teacher is able to wovk this resource into a busy classroom perioo 
an individualized learning lab period or an activity filled day. 

A teacher developed resource that Is ready for convenient use is 
packaged in Ruch a way as to specify learner-centered objectives, learner- 
benefit evaluation criteria, and learner-paced resources. This is how 
convenience is kept from degenerating into laziness. An example of laziness 
would be a teacher who shows a film rather than prepare a lesson and the 
necessary discussion. An example of convenience would be the situation wherein 
a Loaohcr finds exactly Lhe.^right learning package for both the learner in 
need of rcmcdi.Uion and for the learner in need of enrichment. 
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VOCABULARY RKVIH^ 



WORD 


DEFINITION 


USEFUL 


"Capable" of being put to use 

• 

someday 
by someone 
somewhere 

with some students 
for some objectives 


USABLE 


"Rpndy" for immediate, convenient, 
and feasible use 


\ 


today 

by many teachers 

In Tiiriny schools 

with many students 

for objectives relevant to 

many students and teachers 


1 

IMtlEDlATE USE 


The resource is ready for use upon 
"opening" or "arrival," 


CON\'ENIENT USE 


The resource is packaged in such a 
way as to specify: 

learner-centered objectives 
^ learner-benefit evaluation criteria 
learner-paced resources 


FEASIBLIi USE 


Success is very likely. 
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A teacher developed resource is ready for feasible use when success 
is very likely. The likelihood of success is based more upon reactions of 
other teachers, experiences from other schools, and recomni^cndations frotn 
the professional literature. Too many teachers Itive been burned by salesmen 
and advertising claims to base feasibility upon unreliable sources. Few 
teachers will be impressed by an unknown salesman who says upon arrival, 
"I*ve got just what you need," 

The theme of the above introduction can be summarized in the question 
posed by administrators to researchers, "What can you researchers do to 
transform useful teacher developed resources into usable learning packages?" 

The way this question is posed, most rese^trchers spend a large amount 
of time arranging available teacher developed resources into five categories: 

CATEGORY ONE: 

The most xmable resources. 
CATEGORY TWO: 

Above average usable resources. 

CATEGORY TllREE: 

Avera^,e usable resources, 
CATEGORY FOUR: 

Below average usable resources. 
CATEGORY FIVE: 

Unusable resources. 
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There is a certain advantage in using the above five categories. 
After all, teachers are interested in finding resources that fall into 
category one (most usable) and category two (above average usable). 

After all this research is done, the fact remains that many resources 
declared to be of average usableness or below are not coinoletely devoid 
of value. After all, it has been asserted that most ^eacher developed 
resources are useful. Useful means capable of being put to use someday, 
by someone, somewhere, with some students, and for some objectives. 

The reason for reiterating this definition of Useful is to provide 
a basis lor at least two common causes of unusability. 

Some teacher-developed materials and unusable because these same 
materials are UNREADABLE, Other teacher-developed materials are unusable 
because of a WIDE VARIETY OF OTilER REASONS. Some of these other reasons 
might include irrelevant objectives, vague evaluation criteria, impractical 
rcsovrccs, outdated technology, unpopular approaches, unacceptable 
philo&opliical foundations, and unrealistic .expectations « 

The following page entitled A SIMPLIFIED ANALYSIS OF ''UNUSABLE" provides 
a comparison based upon an iceberg. An iceberg presents approximately 10% 
of its bulk above the water line. This means that 90% of an iceberg ic below 
the water line. 

To be quite frank, the present state of unusability research is not 
able to say whether materials found unusable because unreadable outweigh 
materials found unusable because of other reasons. 
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A SIMPLIFIED ANALYSIS OF 'TriUSABLE" 



Above the 
water line 



Below the 
water line 



Unusable because unreadable 



Unusable because of other reasons: 
irrelevant objectives 
vague evaluation criteria 
_ ^ ^ impractical resources 

outdated technology 

_ unpopular approach 

unacceptable philosophy 
_ unrealistic expectations 



Obviously 
unusable 

Above the 
water line 



Unusable 
because of 
hidden defcc- 

Belov/ the 
water lino 
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Even if research could conclusively claim that only 10% of unusable 
teacher-developed materials are unreadable, this would still be a good 
place to begin because readlbility is a problem that can be readily attacked. 

After the above analysis, a new research situation and question 
emerges • 

The former research question was posed to educational researchers by 
school administrators who said, "What can you researchers do to transform 
useful teacher developed resources into usable learning packages?" 

The new research question can be posed to educational researchers by 
classroom teachers who say, "What can you show us to make our teacher- 
developeu resources more READABLE." 

At the present time, research is being designed to ansv/er thir 
question* 

Before the results are in, many educators are interested in the type 
of experimental design being developed. 

The following paragraphs arc intended to give a foretaste of v;hat to 
expect. 

At the present time, it is possible for learners to talk in terms of 
a GAINS SCORE. A gains score is strictly speaking what is learned between the firs 
day of testing and the last day of testing. The first day of testing is 
called the pretest. The last day of testing is called the posttest. 

This leads us to the RULE OF TlIE GAINS SCORE: subtract the pretest 
from the posttest and the result is the gains score. 
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All of this can be visualized graphically. 

Loot: at the follo^.ing page enlitlod GAINS SCORE AS A WIN-LOSS CONTIKUUM. 
Three different situations are presented: 

The learner wins 

The learner loses time 

The learner loses interest / — \ 

In the situation wherein the learner wins, the box representing the 
pretest is smaller than the box representing the posttest. In other words, 
at the end of the course, the students score, final examination grade, 
amount of things learned, or achievement ts larger than at the beginning of 
the course. 

In the situation wherein the learner loses time, the learner's 
measurable success before the course is just about the same as the learner's 
success after the course. Unfortunately, the learner has lost time in this 
situation. 

In the situation wherein the learner loses interest, the pretest is 
larger than the posttest. This doesn't mean that the learner has always 
lost knowledge or skills possessed at the beginning of the course. However, 
this situation often indicates that the learner has lost interest. In many 
cares, the 1(mcv posttest is explained by tlie fact that the learner simply 
did not care enouyjh to put down all he or she knew on the final evaluation 
instrument . 
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GAINS SCORE AS A WIN-LOSS CONTINUUM 



L EARNER W TNS 
(Posttest is bigger than Pretest) 



PRETEST 



POSTTEST 



LEARNER LOST-S TI ME 
(Posttest is same size as Pretest) 



PRETEST 



POSTTEST 



LEiXRNER LOSES I NTEREST 
(Pretest is larger than Posttest) 



PRETEST 



POSTTEST 
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So far, a dist-.nction has been made betv;cen USEFUL and USABLE. 
Another distinction has been made between PRETEST and POSTTEST. 
The next distinction to be made will be bctv/een ACHIEVEMENT and 
OTHER CAUSES OF SUCCESS IN PRETESTING AND POSTTESTING. 

The next page entitled A SIMPLIFIED ANALYSIS OF "SUCCESS'* distinguishes 
betv;een success caused by ACHIEVEMENT success caused by OTHER FACTORS. 
Other factors could include such things . d aptitude, IQ, previous achievement, 
heredity, environment, family, schooling, socio-economic factors, end of.her 
parameters . 

In this simplified analysis of success, it is possible to picture the 
achievement factor resciabling the part of the iceberg ibovc the water while 
the other factors rcsembl'* the part of the iceberg below the surface. 

Th success caused by achievement refers to those measures of rr.astery 
such as d. information, people, attitudes, things, and skills acquired 
as a result of educational effort. 

In using the stardard pretest and posttcst situation, the gains score 
is the .esult of subtracting the pretest from the posttest. 

In other words, the pretest situation resembles the part of the iceberg 
below the surface of the water. It is presumed that the success achieved 
and measured in the pretest is not lost during the training or educational 
process* 

With this assumption, the extra amount that appears in the posttest is 
presumed to be success caused by achievement. In other words, if the posttest 
is higher than the pretext, it is assumed that certain educational Influences 
ore responsible for this increase of success. 
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A SIMPLIFIED ANALYSIS OF "SUCCESS" 



Above the 
surface - 



Below the 
surface 



Success caused by: 

- - ACHIEVE>3i:KT. 
(GAINS SCORZ) 



Success caused by OTHER FACTORS such as; 
Aptitude 
IQ 

_^ Previous achieveiront 
Herdity 

Environment 

Family 

^^^^ Schooling 

Socio-economic factor 
Other parameters 



Above the 
surface 



A. Belov che 
surface 

B. Baseline 
data 

measured in 
pretest 
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Any teacher looking at this cxanple will begin to realize that the gains 
score itself is composed of at least tvo different factors. 

The gains score is composed of success caused by ACHIEVETMEIJT and success 
caused by lOWaKG WIIAT KIKD OF POSTTEST TO EXPECT. For shorthand notation, 
these two factors are abbreviated ACII and TEST. 

There is nothing the matter with the success due to test familarity. 
After^all, this is one way of telling the learner exactly what 'is expected 
WITHOUT revealing the exact questions that will make up the sample of 
evaluation items called the FINAL EXAM. 

This particular point is called to mind in order to prepare the reader 
for H statlsticr.l refinement tliat will be introduced in a later section. This 
is summarized on the following page, A SIMPLIFIED ANALYSIS OF "GMNS SCORE." 




After having distinguished between useful and usable, between pretest 
and posttest, and between achievement and otlier factors, it is now time to 
distinguish between READABILITY and PREVIOUS INFORMATION. 

With this distinction in mind, it will be possible to introduce the 
concept of INFORM^^TION GAINED. 

Let's apply this to a typical classroom situation. 

The teacher has developed some instructional materials about which the 
reading level is unkno;^. Let's call the instructional materials text R. 

The teaclior has developed a 10 question multiple choice question designe 
to measure hov; veil the students understand the information, data, and 
knowledge contained in text R# 
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The 10 question multiple choice examination is given to a group of 
students on Monday. These students have never had any previous exposure 
to text R reading material. 

Even though this test is on "new" material, it is presumed that the pretest 
score will be measuring previous knowledge and guessing ability of the 
group . 

On Tuesday (the next day), the same group receives the same 10 multiple 
choice quGSti3ns. '^he only difference is that on the rest of Monday and on 
the first part of Tuesday, the gr^p had unlimited access to the text R 
reading materials. 

Since no group instruction was provided in addition to the reading 
materials, it is presumed that the posLtest score measures two things: 
first, the previous knowledge and guessing ability of the group and 
second, the infonnation gained made by the group as a direct result of 
reading text R. 

The necessary control here is to make sure that only reading is 
permitted with text R reading material. This would prohibit instruction, 
group interaction, a chance for peer discussion, and the chance to compare 
notes on the questions. 

Because of these empirical limitations, some teachers might find it 
more convenient to have the pretest at 10:00 a.m. and the posttcst at 2:00 p.m. 
Of course, other factors such as lunch, fatigue, and looking up the answers 
might enter inlo this picture. 
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All of these intervening contaminating variables can be contr oiled 
by statistical design. 

The preceding analysis is summed up on the following page entitled, 
A SIMPLIFIED ANALYSIS OF "PRETEST SCORi:"Al{) "POSTTEST SCORE" 



In order to nr^ke this practical, let's take a few examples. 

In the first example, the average class score on the pi-elcst is 707o. 
The average class score on the posttest is 90%. This gives an information 
gain of 20%, Tvcenty percent might scL-m like a good inforr^aticn gain, but 
the point is that tlie high pretest indicated that inost of the class knew 
most of the questions before any exposure to the material. This might 
indicate that the questions are too easy or indeed that the material is 
too easy. 

In the second example, the group pretest average was 20%. The group 
posttest average was 90%. In this second case, the Information j,ain is 
70%. This seems to indicate a high level of readability on the part 

of the students. Of course, care must be taken that contamination does not 
come from inadvertent instruction, group discussion, looking up the answers, 
or memorizing the answers. 

In example three, the group pretest average is 30%. The group posttest 
average is 60%. This gives an information gain of 30%. In itself, 30% 
doesn't mean very much. This pcrcenta^',c gain muft be compared with similcir 




material. 
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A SIMPLIFIED ANALYSIS OF "PRETEST SCORE'^ AND "POSTTEST SCORE" 
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SUMMARY 

I f the pretest is given at 10 am on 
Monday wilhour. any prcsrious 
exposure to Text R reading 
material 

and 

Tf the posttest is given 10 am on 
Tuesday (the next day) and after 
exposure to the Text R reading 
material 

Then the Information Gain can be said 
to be in proportion to the 
READABILITY of Text R 
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In other words, after the teacher has given a protes t-posttcst analyr.is 
to a number of different reading materials, it is possible to scale the 
readability levels of various reading materials by comparing the information 
gained. 

Such a preliminary measure of readability will enable the teacher to 
pinpoint difficult reading material. Once the reading difficulty haiJ been 
corrected, the teacher is able to increase the usability of teacher-prepared 
materials . 

In summary, the teacher has made teacher-prepared materials more USABLE 
by making these materials more READABLE. 

This concludes the scope of the present discussion. As is obvious frori . 
the above , further uiscvssiou can be devoted to such topics as experimental 
control, computerization of the pretesting and posttesting, and the typical 
errors that need to be corrected in order 'to make a text more readable. 

It is felt that making teachers aware of the simijle process of making 
teacher-prepared materials more usable by making them more readable is the 
major concern of this discussion. 
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